Characterising the Quality of Online Task-Based Application Tutorials

End-user authored tutorials are increasingly becoming the norm for assisting users with learning software applications, but little is known about the quality of these tutorials. Using metrics derived from previous work, I characterize the quality of textand image-based Photoshop tutorials available to users online. I compare these tutorials across four sources representing tutorials that are, i) written by a close-knit online community, ii) written by expert users, iii) most likely to be found, and iv) representative of the general population of tutorials. I found that not only are expert users generally writing higher quality tutorials than the other authors, but also, many of the typical tutorials are suffering from some important limitations. Most notably, they often lack attempts to help users avoid common errors, and seldom provide users with appropriate amounts of reasoning for undertaking steps. I also examine a typical tutorial rating system and find that it does not sufficiently distinguish quality between tutorials. I demonstrate the use of my findings by presenting two applications that I designed: a tutorial authoring tool, and a tutorial presentation site.